WORLD INTELLECTUAL PROPERTY ORGANIZATION 
Inlemaiional Bureau 



PCX 



INTERNATIONAL APPUCATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(51) International Patent Classification 7 ; 

A61B 6/00, 6/14 



Al 



(11) International Publication Number: 
(43) International Publication Date: 



WO 00/25677 

11 May 2000(11.05.00) 



(21) International Application Number: PCTr/IL99/00577 

(22) International Filing Date: 1 November 1999 (01.1 1.99) 



(30) Priority Data: 

126838 1 November 1998 (01,1 1.98) IL 



(71) Applicant (for all designated States except US): CADENT 

LTD. [IL/IL]; 14 Hayetzira Street, 60370 Or Yehuda (IL). 

(72) Inventors; and - 

(75) Inventors/Applicants (for US only): KOPELMAN, Avi 

[lUIL); 8 Ido Street, Ramat-Chen, 52233 Tel Aviv (IL). 
TAUB, Eldad [lUIL]; 1 1 Topaz Street, 71908 Reut (IL). 

(74) Agent: REINHOLD COHN AND PARTNERS; P.O. Box 4060, 
61040 Tel Aviv (IL). 



(81) Designated States: AE, AL, AM, AT, AU, AZ, BA, BB, BG. 
BR, BY, CA, CH. CN, CR, CU, CZ, DE, DK, DM, EE, 
ES, FI, GB, GD, GE, GH. GM, HR, HU, ID, IL, IN, IS, JP. 
KE. KG, KP, KR, KZ. LC, LK, LR, LS, LT, LU, LV, MA, 
MD, MG, MK, MN, MW, MX. NO, NZ, PL, PT, RO, RU. 
SD, SE, SG, SI, SK, SL, TJ, TM, TR, TT, TZ. UA, UG, 
US, UZ. VN, YU, ZA, ZW, ARIPO patent (GH, GM, KE, 
LS, MW, SD, SL. SZ, TZ, UG, ZW). Eurasian patent (AM. 
AZ, BY, KG, KZ, MD, RU, TJ, TM), European patent (AT, 
BE, CH, CY, DE, DK, ES, FI, FR. GB, GR, IE, IT, LU, 
MC, NL, PT. SE). OAPI patent (BF. BJ, CF, CG. Cl, CM, 
GA, GN, GW. ML, MR, NE, SN, TD. TG). 



Published 

With international search report. 



(54) Title: DENTAL IMAGE PROCESSING METHOD AND SYSTEM 




(57) Abstract 

An image processing method for use in dentistry or orthodontic is provided. Two images of teeth, one being a two-dimensional 
image and one a three-dimensional image are combined in a manner to allow the use of information obtained from one to the other In 
order to combine the two images a set of basic landmarks is defined in one, identified in the other and then the two images are registered 



BEST AVAILABLE COPY 




FOR THE PURPOSES OF INFORMATION ONLY 

Codes used to identify States party to the PCT on the front pages of pamphlets publishing international applications under the PCT. 



AL Albania 

AM Armenia 

AT Austria 

AU Australia 

AZ Azerbaijan 

BA Bosnia and Herzegovina 

BB Barbados 

BE Belgium 

BF Burkina Faso 

BG Bulgaria 

BJ Benin 

BR Brazil 

BY Belarus 

CA Canada 

CF Central African Republic 

CG Congo 

CH Switzerland 

Cl C6ie dTvoire 

CM Cameroon 

CN China 

CU Cuba 

CZ Czech Republic 

DE Germany 

DK Denmark 

EE Estonia 



ES 


Spain 


LS 


Lesotho 


SI 


Slovenia 


FI 


Finland 


LT 


Lithuania 


SK 


Slovakia 


FR 


France 


LU 


Luxembourg 


SN 


Senega] 


GA 


Gabon 


LV 


Latvia 


sz 


Swaziland 


GB 


United Kingdom 


MC 


Monaco 


TD 


Chad 


GE 


Georgia 


MD 


Republic of Moldova 


TG 


Togo 


GH 


Ghana 


MG 


Madagascar 


TJ 


Tajikistan 


GN 


Guinea 


MK 


The former Yugoslav 


TM 


Turkmenistan 


GR 


Greece 




Republic of Macedonia 


TR 


Turkey 


HU 


Hungaiy 


ML 


Mali 


TT 


Trinidad and Tobago 


IE 


Ireland 


MN 


Mongolia 


UA 


Ukraine 


IL 


Israel 


MR 


Mauritania 


UG 


Uganda 


IS 


Iceland 


MW 


Malawi 


US 


United States of America 


IT 


Italy 


MX 


Mexico 


uz 


Uzbekistan 


JP 


Japan 


NE 


Niger 


VN 


Viet Nam 


KE 


Kenya 


NL 


Netherlands 


YU 


Yugoslavia 


KG 


Kyrgyzstan 


NO 


Norway 


zw 


Zimbabwe 


KP 


Democratic People’s 


NZ 


New Zealand 








Republic of Korea 


PL 


Poland 






KR 


Republic of Korea 


PT 


Portugal 






KZ 


Kazakstan 


RO 


Romania 






LC 


Saint Lucia 


RU 


Russian Federation 






LI 


Liechtenstein 


SD 


Sudan 






LK 


Sri Lanka 


SE 


Sweden 






LR 


Liberia 


SG 


Singapore 









wo 00/25677 



- 1 - 



PCT/IL99/00577 






DENTAL IMAGE PROCESSING METHOD AND SYSTEM 



FIELD OF THE INVENTION 

The present invention is generally in the field of dentistry snd provides 3 n 
image processing method and system useful as a tool by the dentist or orthodont. 



5 BACKGROUND OF THE INVENTION 

There are a wide variety of imaging techniques used routinely in 
orthrdontics. One important imaging technique is the so-called radiographic 
cephalometric technique. A radiographic cephalometric image is then used for a 
cephalometric analysis. Such an analysis is essentially a measurement system 
10 designed to describe relationships between the various parts of the skeletal, dental 
and soft tissue elements of the cranofacial complex. The two cephalometric images 
typically used are a lateral cephalometric image, which is of prime use in 
orthodontic and a front cephalometric image which is of somewhat less importance. 

Cephalometric methods enable to define certain norms of a skeletal, dental 
15 and soft tissue of the cranofacial complex. A cephalometric measurement of 
individuals can then be compared with norms for age, sex and population group. A 
cephalogram is in effect a two-dimensional representation of a three-dimensional 
cranofacial structure. It is thus difficult in an analysis performed on such an image 
to distinguish between bi-lateral structures to trace them independently. 
20 Additionally, facial aspects are not entirely asymmetrical, this may add a further 
inaccuracy to an analysis of this kind. Other sources of errors in a cephalometric 
unage include different magnification of different aspects depending on the 
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distance from the film and imperfect positioning of the patient in the cephalostat. 
These all add up to considerable errors in cephalometry. 

An orthodont, prior to beginning the orthodontic treatment typically takes a 
teeth impression on the basis of which a plaster model may be prepared. There are 
5 known also a number of imaging techniques which allow to obtain, within a 
computer environment, a virtual three-dimensional image of the teeth. Such 
techniques are described for example in WO 97/03622 and DE-C-414311. A 
three-dimensional teeth image provides a different information than that obtained 
by a cephalometric analysis. Particularly, a virtual teeth image allows better 
10 appreciation of the three-dimensional structure of the teeth and the relative position 
of different teeth. 

For the purpose of proper design of orthodontic treatment it would have 
been high advantageous to have a method and system whereby information which 
can be acquired from one type of image can be transferred or superpositioned to 
15 information available from another type of image. 

GENERAL DESCRIPTION OF THE INVENTION 

In accordance with the invention a novel method and system is provided in 
which information and data available from one type of teeth imaging technique is 
transferred and used in an image obtained by another kind of teeth imaging 
20 technique. This transfer of mformation provides the dentist or the orthodont with a 
powerful tool for designing of orthodontic treatment. 

In accordance with the invention there is provided an image processing 
method comprising: 

(a) applying at least a first unaging technique and a second imagining 
25 technique to acquire a first, two-dunensional image of at least a first 

portion of teeth and a second, three- dimensional virtual image of at 
least a second portion of the teeth, respectively, there being at least a 
partial overlap between said first and second portions; and 
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(b) defining a set of basic landmarks in either one of the two images, 
locating said set in the other of the two images and registering said 
set in the two images. 

By another of its aspects the present invention provides an image processing 
5 system, comprising: 





(i) 


a first utility for receipt of first data representative of a first 
two-dimensional image of at least a first teeth portion; 




(ii) 


a second utility for receipt of second data representative of a second 
three-dimensional virtual image of teeth of at least a second teeth 


10 




portion; 




(hi) 


a module for defining basic landmarks in both images and for 
generating data representative thereof; and 




(iv) 


a processor associated with said first and said second utility and with 
said module, for receiving said first and said second data and for 


15 




mapping elements in one of the two images to the other of the two 
images according to the data representative of said basic landmarks. 



In accordance with one embodiment of the invention, the imaging method 
and system is used to obtain orthodontic-relevant information, namely information 
to be used by an orthodont within the framework of an orthodontic treatment or for 
20 the design of such a treatment. This embodiment involves a registration of at least 
two images, one being a three-dimensional virtual image of a teeth model and the 
other being a two-dimensional image, e.g. a cephalometric image. Occasionally, 
other images may also be brought into registration consisting, for example of one or 
more of a lateral videographic image, a frontal videographic image and a frontal 
25 cephalometric image. 

In accordance with another embodiment of the invention, the method and 
system are used for proper design of a dental implant or of a crown. For proper 
placement of an implant, the bone has to be carefully studied beforehand and 
examined whether it can receive the dental implant. In addition, the exact position 
30 a.nd orientation of the dental implant has to be properly pre-designed. Typically, for 




V 
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a proper design of an implant, a three-dimensional virtual image of a teeth model is 
brought into registration with both a lateral cephalometric image and at times also 
with a frontal cephalometric image. This will allow to properly predict the manner 
of receipt of the implant within the bones of the jaw. 

5 In the following, the invention will be described with particular reference to 

imaging for the purpose of design of the orthodontic treatment. It will however be 
appreciated, that the invention applies, mutatis mutandis also to its application for 
the purpose of proper design of tooth implants. 

The first image is preferably an x-ray image, typically a cephalometric 
10 image obtained by radiographic cephalometric technique. The x-ray image is 
preferably a lateral image although at times the image may be from another 
orientation, e.g. a frontal image. In a cephalometric image, some facial profile 
aspects may at times be seen. However, typically, before an orthodontic treatment 
also a third, side elevational view of the face is taken from the same direction in 
15 which the radiographic cephalometric image was obtained. In accordance with an 
embodiment of the invention, such a third image, comprising at least a profile of 
facial aspects, is also obtained and used In the imaging technique of the invention. 
The side elevational image may be obtained, for example, by video cephalometry. 

The term "virtual three-dimensional teeth image” refers to an image, 
20 represented within the computer environment which consists primarily of the teeth 
of one or both jaws. For example, a virtual three-dimensional teeth image may be 
represented in a manner resembling an image of a plaster model. A virtual 
three-dimensional image may be obtained by a variety of techniques, e.g. those 
described in the references mentioned above. Particularly, the three-dimensional 
25 virtual image may be obtained by the method described in WO 97/03622, which is 
incorporated herein by reference as an example of the manner of obtaining a 
three-dimensional virtual image for use in the method and system of the invention. 
It should be understood that the invention is not limited to a specific type of image 
obtained by one imaging technique or another. For example, the two-dimensional 
30 image may be obtained by a variety of different imaging techniques including 
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magnetic resonance imaging (MRI), computerized tomography (CT) various radio- 
imaging techniques, etc. Similarly, the three-dimensional teeth image may be 
obtained by any one of a number of imaging techniques available including those 
disclosed in the aforementioned references as well as others such as those making 
5 use of a scanning probe, various photographic techniques, techniques in which 
teeth are scanned by a probing light beam, etc. 

The term "image ” as used herein should not be understood only as referring 
to the image as acquired in the imaging technique but rather may be also a result of 
initial image processing, e.g. an image processing intended to define boundaries of 
10 various objects in the image. Thus, the term “image” encompasses also a 
representation, prepared on the basis of an acquired image, of boundaries of 
objects, e.g. teeth, bones, a profile of facial aspects, etc. 

Often, the imaging technique and analysis in accordance with the invention 
will make use of a third image, which may be the elevational image mentioned 
15 above, or any other image useful in improving the orthodontic analysis. Thus, by 
way of example, where said first image is a lateral two- dimensional image, said 
third image may be one or bodi of the afore- mentioned lateral elevational image or 
a fi-ontal x-ray or videographic image. 

The basic landmarks which are used for registering the two sets of images, 
20 are typically defined points at either the base or the apex of certain selected teeth 
e.g. the incisors and the first molars. Such basic landmarks may be selected by the 
user or may be automatically selected by the system’s processor, e.g. based on 
established norms. After selecting the basic landmarks and marking them in one of 
the images, then the landmarks may be marked in the other images to allow to 
25 register both images. The term "registering” should not necessarily be understood 
as meaning a physical registration of the two images but rather as meaning the 
mapping of each feature in one image to a corresponding feature in another. The 
outcome of such registration is that any manipulation made on one image will yield 
a corresponding manipulation in the other image. For example, if one image is 
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manipulated by displacing one tooth, this should result in a corresponding 
displacement of the same tooth in the other image. 

At times it may be desired to view both images on a screen superimposed 
one on the other. As two or more images have to be superimposed may be 
5 presented initially at a different scale, an initial step which is necessary to be taken 
by the system is to either enlarge or reduce the scale of one image until there is an 
essential complete overlap of the basic landmarks in the two images. It should 
however be noted that registering of different images may not necessarily imply 
superpositioning, but rather at times the two registered images may be represented 
10 separately, e.g. side-by-side. The important result of the act of registering is that 
manipulation made on one of the images will effect the other as well. 

In the following, the invention will be described with particular reference to 
an embodiment in which the first image is a cephalometric image and the second 
image is a virtual three-dimensional image. This specific reference should not 
15 however be constmed as meaning that the invention is limited thereto. On the 
contraiy, by applying the general teaching of the invention, information may be 
transferred between images obtained by other imaging techniques. 

In accordance with one embodiment of the invention, after landmarks have 
been defined in the three-dimensional virtual images and in the cephalometric 
20 image, the correct orientation of the virtual three-dimensional teeth model has to be 
determined so as to allow it to be brought into conformity with the cephalometric 
image. This may at times require extensive computational time. It has however 
been found that the process of registration of the two images can be considerably 
accelerated by defining the cephalometric image to overlap the mid palatal plane of 
25 the virtual three-dimensional teeth image. In other words, the cephalometric image 
is defined to lie on the mid palatal plane and the cephalographic image is then 
adjusted until the basic landmarks overlap with the projection of the corresponding 
basic landmarks of the virtual three-dimensional image onto the mid palatal plane. 

The invention permits also an analysis of the effect of teeth displacement on 
30 various aspects of the cranofacial complex. For example, teeth may be displaced on 
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the virtual three-dimensional image of teeth model in a manner they are expected to 
be shifted during the course of the orthodontic treatment. Thus, for example, by 
marking various landmarks on a displaced teeth and marking and then displacing 
the same landmarks in the cephalometric model, it may be possible to check on 
5 both images whether the orthodontic treatment achieves a result which matches a 
certain acceptable norm or how changes should be made to achieve such a norm. If, 
for example, a desired result as viewed in an amended cephalometric image 
(namely a cephalometric image after a tooth has been displaced) does not match the 
desired results, it is possible to go back to the virtual three- dimensional teeth 
10 model and proceed with a simulation and then map the results onto the 
cephalometric image, and so forth. 

By way of example, in order to achieve the same degree of displacement in 
one image, the shifting of a certain landmark which is associated with a displaced 
object is then compared to some basic landmarks and the same relation of 
15 displacements is then related to the other image. 

One particular example of analysis which can be made by such simulation is 
to determine the effect of such displacement on soft facial tissue, particularly outer 
facial tissue. This will allow an estimation of the effect of the orthodontic treatment 
on the esthetic appearance of the individual. 

20 A simulation of the treatment and then translation of the results to a 

cephalometric image allows also to determine whether shifts in various elements 
such as the jaw, are within permitted physiological or aesthetical limits. An 
uncontrolled shifting of a tooth or a jaw in an orthodontic treatment may give rise 
to various physiological and functional problems. 

25 The invention will now be illustrated below with reference to some specific, 

non-limiting embodiments, with occasional reference to the accompanying 
drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
30 Fig. lA shows an example of a radiographic cephalometric image. 
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Fig. IB shows a virtual three-dimensional image of teeth, presented in the 
manner resembling a plaster teeth model. 

Fig. 2 shows a super-position of a three-dimensional teeth model and a 
cephalometric image. 

5 Figs. 3A and 3B show two examples of super-position of a three- 

dimensional model and a video cephalometric image. 

Fig. 4A shows a cephalometric image with some basic landmarks marked 
thereon. 

Fig. 4B shows a three-dimensional virtual image of the same teeth as those 
10 shown in the cephalometric image of Fig. 4A, with the same basic landmarks 
marked thereon. 

Fig. 5 shows a super-position of the two images. 

Fig. 6 is a block diagram representation of a system in accordance with the 
invention. 

15 Figs. 7A and 7B are flowcharts showing the manner of mapping elements 

from a three-dimensional virtual teeth model to a cephalometric image. Fig. 7A 
shows the user’s interaction modules whereas Fig. 7B shows the software 
functionality underlying the manner of performing of displacement and mapping 
the displacement from the three-dimensional virtual teeth model to the 
20 cephalometric image. 

Figs. 8 A and 8B are flowcharts showing the manner of mapping elements 
from a cepthalometric image to a three-dimensional virtual teeth model. Fig. 8A 
shows the user’s interaction modules whereas Figs. 8B shows the software 
functionality underlying the manner of performing of displacement and map ping 
25 the displacement from the cephalometric image to the virtual three-dimensional 
teeth model. 

DETAILED DESCRIPTION OF SPECIFIC EMBODIMENTS 

In accordance with the present invention images are acquired including at 
30 least one two-dimensional teeth image and at least one three-dimensional teeth 
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image and both are combined for the purpose of improving the orthodont’s ability 
to predict the effect of orthodontic treatment on various parameters. This 
combination allows the orthodont to considerably increase the depth of his 
understanding on the outcome of the orthodontic treatment. Hitherto, analysis 
5 which was made on a cephalometric images could not have been readily translated 
to the other tools available to him - this being the three-dimensional teeth model, 
typically a plaster model. In the reverse, information gained by him from studying a 
three-dimensional teeth model, could not have been readily translated to a 
cephalometric image. As is well known to the artisan, each one of the images 
10 allows a limited range of analysis which can be made and a true analysis can only 
be gained from thorough analysis based on the two types of images. 

It is only with the present invention that a proper analysis becomes feasible. 

An image, once acquired and converted to a representation within a 
computer environment can be manipulated, e.g. by displacing certain elements, 
1 5 such as one or more teeth or even an entire jaw. The cepthalometric image allows 
to view the interrelation between some elements and may be used, for example, to 
test the effect of the treatment on some physiological or functional parameters as 
well as the aesthetic parameters. There is, however, a significant deficiency in that 
it is impossible to fully translate this information to the three-dimensional real-life 
20 environment. The present invention permits a proper analysis of the effect of 
displacement of elements and or better understanding of how changes will effect 
the real-life situation. 

Reference is first being made to Figs lA and IB, showing respectively, a 
cephalometric radiograph and a three-dimensional virtual teeth image. The virtual 
25 teeth image which is shown in Fig. IB, is represented in a manner resembling a 
plaster teeth model. As will no doubt be appreciated by the artisan, this is but an 
example, and the two-dimensional or the virtual three dimensional teeth image may 
be represented in a different way. 

Prior to the present invention, each of these different images, was 
30 represented separately. The three-dimensional virtual image was represented either 
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as a plaster model or a three-dimensional virtual representation in a computer 
environement. In accordance with the invention, two different images, one being a 
two-dimensional image, e.g. a cephalometric radiograph, is combined with a 
three-dimensional teeth image. A super-position of two such images is represented 
5 in exemplary Fig. 2. As can be seen, the cephalometric image is combined with the 
three-dimensional virtual teeth image such that it lies on the mid palatal plane of 
the three-dimensional virtual teeth image. The relative position of the two images is 
fixed such that basic landmarks defined in the two images concur, as will be 
described further below. 

10 Another implementation of the invention can be seen in exemplary Figs. 3A 

and 3B. In these figures, a three-dimensional virtual teeth image is superpositioned 
with a lateral or profile picture of an individual. The profile pictures in Figs. 3A 
and 3B are each from a slightly differently orientation and accordingly the virtual 
three-dimensional teeth model in Fig. 3B is rotated with respect to the orientation 
15 of the model in Fig. 3 A. 

In order to combine a cephalometric image and a three-dimensional virtual 
model, basic landmarks have to be defined and marked in both images. These basic 
landmarks may be entered manually by the user, although alternatively, they may be 
automatically generated by a computer, based on standard image analysis method, 
20 or based on an earlier user input. Generally, such basic landmarks may be arbitrary 
landmarks or may be orthodontic relevant landmarks which may be used later in a 
cephalometric analysis, in accordance with one of the acceptable norms therefor. 
(For review on a cephalometric analysis see Radiographic Cephalometry, From 
Basics to Videoimaging, Jacobson A., et al. Quintessence Publishing Co., Inc., 
25 Chicago, Berlin, 1995). 

A cephalometric radiograph and the three-dimensional teeth model from the 
same individual, are shown in Figs. 4A and 4B. In these figures, two basic 
landmarks have been marked — LI and L2. After these landmarks have been 
marked, the two images are brought into registration which results in 
30 super-positioning as can be seen in Fig. 5 (the same two landmarks LI and L2 can 
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also be seen here). The registration in the manner shown in Figs. 4A, 4B and 5 is 
performed using two defined landmarks. Obviously, it is possible at times to use 
more landmarks for this purpose to increase accuracy of registration. 

In order to reduce computational time, the cephalometric radiograph is 
5 combined with the three-dimensional virtual teeth image by placing (in a virtual 
sense) the cephalometric image on the mid palatal plane. For proper registration, 
the scale of the two images has to be adjusted and then one image has to be shifted 
versus the other until the projection of the basic landmarks of the three-dimensional 
virtual image of teeth model onto its mid palatal plane are in register with the 
10 corresponding landmarks in the cephalometric image. 

The cephalometric radiograph and the cephalometric videograph as shown 
herein, are images as acquired by the utilized imaging technique. It should however 
be noted that at times it is advantageous to produce initially a representation of the 
image, e.g. a graphic representation of boundaries of objects of interest within the 
15 image. For example, rather than a full cephalographic image, a representation 
comprising boundaries of some major bones and several teeth, e.g. the first and 
second molar teeth and the incisors. These aforementioned teeth are usually the 
important teeth for the cephalometric analysis, as their position is relatively 
sensitive to displacement of teeth and jaws. Furthermore, the position of these teeth 
20 is an important marker for studying or gauging the effect of teeth position on 
various functional as well as aesthetical facial aspects. 

Producing a graphical representation of some aspects of an image, 
particularly of a cephalometric image, is very useful for the purpose of a virtual 
displacement of the teeth in the image so as to study the effect of the treatment on 
25 functional or facial aesthetic parameters, as generally known per se. 

A system in accordance with the embodiment of the invention can be seen 
in Fig. 6. It comprises a central computing unit 20 with three input utilities 22, 24 
and 26, which may be integral within module 28. These utilities may comprise, as 
known per se, a data entry port and the necessary data transfer software. 
Furthermore, rather than importing of data through a data entry port, the data to 



30 
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these utilities may be imported from a storage media or from an information carrier, 
e.g. a magnetic or an optical disk. As will no doubt be further understood, 
module 28 may also comprise a scanner for scanning images, may comprise a 
camera for direct image acquisition, etc. 

5 The system still further comprises a module 30, connected to a user input 

interface 32 e.g. a keypad, a cursor driver, etc. By means of interface 32 the user 
may define the landmarks or may induce the system to enter into various 
operational modes, some of which will be explained below. 

Module 30 and utility 28 are connected to a processor 40 for image 
10 processing so as to combine the two images as described, for example further 
below. Processor 40 may be connected to monitor 50 and may be also connected to 
other display means, e.g. a printer. 

A flowchart of an embodiment of the manner of linking between a 
three-dimensional virtual teeth model and a cephalometric image cem be seen in 
15 Figs. 7A and 7B. Fig. 7A is a flowchart of the user interaction steps whereas Fig. 
7B is a software functionality flowchart on the manner of combining the two 
unages. At a first step 100, the system receives an input of data representative of a 
three-dimensional virtual teeth model. Then at 110, basic landmarks are marked on 
discemable objects in the three-dimensional virtual teeth model as represented in 
20 image 111. Such basic landmarks may, for example, be points on crowns and roots 
of upper and lower first molars (landmarks 1-4 of image 111) as well as on croAvns 
and roots of upper and lower centrals (landmarks 5-8 in image 111). Landsmarks 1 
and 4 as well as landmarks 5 and 8 mark the approximate position of the roots of 
the teeth. The real root position cannot be seen in such a model but the orthodont, 
25 based on his experience, can relatively accurately mark their roots’ position. 

At a next step 120, a cephalometric image of the same patient is input and 
on this image, the same key points are then marked (see 131). Then, the two images 
may be matched, which may be by way of super-position as shown above, which 
can be represented on a screen, or by any other way of mapping of each location in 
30 one image to that of the other image. 
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i. 



At a next step 140 teeth and jaws in the three-dimensional model may be 
displaced on the three-dimensional model to receive a desired result. Then, as 
represented in the flowchart of Fig, 7B, the software at next steps 150 and 160 
moves skeletal elements and teeth, respectively, according to movement performed 
5 by the user on the three-dimensional virtual teeth model. Then, at 170, a 
cephalometric analysis can be made on the amended (after displacement) 
cepthalometric image to see whether desired proportional measurements have been 
reached in such teeth displacement or whether any medication should be made. 

The reverse sequence of operation, namely the mapping of each point jOrom 
10 a cephalometric image to a three-dimensional virtual teeth model is seen in Figs. 
8A and 8B. In Figs. 8A and Fig. 8B, each of steps 200-270 corresponds, mutatis 
mutandis to the steps 100-170 in Figs. 7A and 7B. This eventually results in 
mapping of each point in a cephalometric image to the corresponding location of 
the three-dimensional virtual teeth model to allow to translate any displacement 
15 performed on the former image to that in the latter. 




wo 00/25677 



-14- 



PCT/IL99/OOS77 






5 



10 



CLAIMS: 

1. An image processing method comprising: 

(a) applying at least a first imaging technique and a second imaging 
technique to acquire a first, two-dimensional image of at least a first 
portion of teeth and a second three-dimensional virtual image of at 
least a second portion of the teeth, respectively, there being at least a 
partial overlap between said first and second portions; and 

(b) defining a set of basic, landmarks in either one of the two images, 

locating said set in the other of the two images and registering said 
set in the two images. 

2. A method according to Claim 1, wherein said first image is a longitudinal 
cross-sectional image. 

3. A method according to Claim 2, wherein said first imaging technique is a 
radiographic x-ray technique. 



15 4. A method according to Claim 3, wherein said first image is cephalometric 
image. 

5. A method according to any one of Claims 1-4, wherein step (a) comprises 
applying a third imaging technique to acquire a third image comprising at least a 
profile of facial aspects. 

20 6. A method according to any of Claims 1-4, wherein said three-dimensional 
image comprises substantially all teeth of at least one jaw, and the two-dimensional 
image is positioned on the mid palatal plane of the three-dimensional image. 

7. A method according to Claim 1, comprising the following step; 

(c) displacing at least one tooth in at least one of the images in a manner 

25 resembling the manner in which said at least one tooth can be shifted 

in real-life orthodontic treatment; and 

(d) by applying a set of rules which define maimer in which each element 
in one image maps to a corresponding element in the other image, 
displacing said at least one tooth in said other image. 
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8. A method according to Claim 7, wherein said set of rules comprise defining 
in said one image at least one object-associated landmark of said at least one tooth, 
locating said object-associated landmark, and displacing said object-associated 
landmark in said other image, in proportion to its movement in said one image. 

5 9. • A method according to Claim 8, wherein said basic landmarks are fixed, the 
displacement of the at least one object-associated landmark in said one image is 
defined according to said basic landmarks and said at least one object-associated 
landmark is then displaced in the same relative displacement in respect of the basic 
landmarks in said other image. 

10 10. A method according to any one of Claims 7-9, wherein said one image is a 
virtual three-dimensional image of a teeth model and said other image is a lateral 
image. 

11. A method according to Claim 10, wherein said lateral image is a 
cephalometric image. 

15 12. A method according to Claim 11, comprising the following step: 

(e) by applying a set of rules defining displacement of soft facial tissue caused 
by displacement of said at least one tooth, predicting effect of the displacement of 
said at least one tooth in said virtual three-dunensional image on soft facial tissue 
image in said lateral image. 



20 13. A method according to Claim 12, wherein the displacement of said soft 
tissue is predicted using a third image of at least a profile of facial aspects. 

14. An image processing system comprising: 





(i) 


a first utility for receipt of first data representative of a first 
two-dimensional cross-sectional image of at least a first teeth portion; 


25 


(ii) 


a second utility for receipt of second data representative of a second, 
three-dimensional virtual image of teeth model of at least a second 
teeth portion; 




(iii) 


a module for defining basic landmarks in both images and for 
generating data representative thereof; and 




wo 00/25677 



-16- 



PCT/IL99/00577 



(iv) a processor associated with said first and said second utility and with 
said module, for receiving said first and said second data and for 
mapping elements in one of the two images to the other of the two 
images according to the data representative of said basic landmarks. 

5 15. A system according to Claim 14, wherein said first image is a cephalometric 
image. 

16. A system according to Claim 15, comprising a third utility for receipt of 
third data representative of a third image comprising at least a profile of facial 
aspects. 

10 17. A system according to any one of Claims 13-16, wherein the first, second 
and third utilities are integral. 

18. A system according to any one of Claims 13-17, wherein said second utility 
comprises a data transferring module for transferring data representative of the 
second, virtual three-dimensional image to the processor. 

15 19. A system according to any one of Claim 13-18, comprising a module 
defining a set of rules for displacing at least one virtual tooth representation in one 
of the images. 

20. A system according to Claim 19, wherein said set of rules define a 
displacement representing the manner of shifting of the at least one tooth in a 

20 real-life orthodontic treatment. 

21. A system according to Claim 19, wherein said processor translates the 
displacement of said at least one virtual tooth representation in one of the images to 
displacement of a corresponding tooth in the other image. 

22. A system according to Claim 21, wherein said one of the images is a virtual 
25 three-dimensional image of teeth model, and the other image is a cephalometric 

image. 

23. A system according to Claim 22, comprising a module defining a set of 
rules for predicting the effect of displacement of teeth in the cephalometric image 
of soft facial tissue. 
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FIG.3A 




FIG.3B 
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FIG.7A 






FIG.7B 
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